Newton-like Polynomial-Coded Distributed Computing for Numerical Stability
نویسندگان
چکیده
For coded distributed computing (CDC), polynomial code is one prevalent encoding method for CDC (called Poly-CDC). It suffers from poor numerical stability due to the Vandermonde matrix serving as coefficient which needs be inverted, and whose condition number increases exponentially with size of or equivalently parallel worker nodes. To improve stability, especially large networks, we propose a Newton-like (NLPC)-based (NLPC-CDC), design dedicated both matrix–vector matrix–matrix multiplications. The associated proof constructed possesses (n,k)-symmetrical combination property (CP), where symmetrical means nodes have identical computation volume, CP k-symmetrical original tasks are encoded into n(n≥k)-symmetrically tasks, arbitrary k resulting n-coded can recover intended results. Extensive studies verify significant improvement our proposed NLPC-CDC over Poly-CDC.
منابع مشابه
Coded Computing for Distributed Graph Analytics
Many distributed graph computing systems have been developed recently for efficient processing of massive graphs. These systems require many messages to be exchanged among computing machines at each step of the computation, making communication bandwidth a major performance bottleneck. We present a coded computing framework that systematically injects redundancy in the computation phase to enab...
متن کاملNumerical solution for the risk of transmission of some novel coronavirus (2019-nCov) models by the Newton-Taylor polynomial solutions
In this paper we consider two type of mathematical models for the novel coronavirus (2019-nCov), which are in the form of a nonlinear differential equations system. In the first model the contact rate, , and transition rate of symptomatic infected indeviduals to the quarantined infected class, , are constant. And in the second model these quantities are time dependent. These models are the...
متن کاملComponent-Based Distributed Computing for Numerical Simulation
This paper describes the use of a component-based distributed computing, DCOM, for a numerical simulation problem. Component-based distributed computing, such as CORBA, DCOM, and Java RMI, by distributing objects to be executed by networked computers, network of workstations, or PC clusters, has potential for use in large scale scientific simulation problems. DCOM developed by Microsoft is used...
متن کاملNewton-like method with diagonal correction for distributed optimization
We consider distributed optimization problems where networked nodes cooperatively minimize the sum of their locally known convex costs. A popular class of methods to solve these problems are the distributed gradient methods, which are attractive due to their inexpensive iterations, but have a drawback of slow convergence rates. This motivates the incorporation of second-order information in the...
متن کاملCoded Distributed Computing with Node Cooperation Substantially Increases Speedup Factors
This work explores a distributed computing setting where K nodes are assigned fractions (subtasks) of a computational task in order to perform the computation in parallel. In this setting, a well-known main bottleneck has been the internode communication cost required to parallelize the task, because unlike the computational cost which could keep decreasing as K increases, the communication cos...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Symmetry
سال: 2023
ISSN: ['0865-4824', '2226-1877']
DOI: https://doi.org/10.3390/sym15071372